Papers with fully unsupervised learning method
Universal Sentence Representation Learning with Conditional Masked Language Model (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to learn sentence representations on unlabeled corpora are difficult and expensive to obtain, making it hard to cover many domains and languages. |
| Approach: | They propose a method to train sentence representations on large unlabeled corpora by conditioning on the encoded vectors of adjacent sentences. |
| Outcome: | The proposed method outperforms existing models on SentEval and can be extended to a broad range of languages and domains. |